Log-Sigmoid Multipliers Method in Constrained Optimization

نویسنده

  • Roman A. Polyak
چکیده

In this paper we introduced and analyzed the Log-Sigmoid (LS) multipliers method for constrained optimization. The LS method is to the recently developed smoothing technique as augmented Lagrangian to the penalty method or modified barrier to classical barrier methods. At the same time the LS method has some specific properties, which make it substantially different from other nonquadratic augmented Lagrangian techniques. We established convergence of the LS type penalty method under very mild assumptions on the input data and estimated the rate of convergence of the LS multipliers method under the standard second order optimality condition for both exact and nonexact minimization. Some important properties of the dual function and the dual problem, which are based on the LS Lagrangian, were discovered and the primal–dual LS method was introduced.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On the Convergence Properties of a Majorized Alternating Direction Method of Multipliers for Linearly Constrained Convex Optimization Problems with Coupled Objective Functions

In this paper, we establish the convergence properties for a majorized alternating direction method of multipliers for linearly constrained convex optimization problems,whose objectives contain coupled functions.Our convergence analysis relies on the generalized Mean-Value Theorem, which plays an important role to properly control the cross terms due to the presence of coupled objective functio...

متن کامل

Linearized Alternating Direction Method of Multipliers for Constrained Nonconvex Regularized Optimization

In this paper, we consider a wide class of constrained nonconvex regularized minimization problems, where the constraints are linearly constraints. It was reported in the literature that nonconvex regularization usually yields a solution with more desirable sparse structural properties beyond convex ones. However, it is not easy to obtain the proximal mapping associated with nonconvex regulariz...

متن کامل

A Proximal Point Analysis of the Preconditioned Alternating Direction Method of Multipliers

We study preconditioned algorithms of alternating direction method of multipliers type for non-smooth optimization problems. The alternating direction method of multipliers is a popular first-order method for general constrained optimization problems. However, one of its drawbacks is the need to solve implicit subproblems. In various applications, these subproblems are either easily solvable or...

متن کامل

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

A large class of optimization problems can be modeled as minimization of an objective function subject to constraints given in a form of set inclusions. We discuss in this paper augmented Lagrangian duality for such optimization problems. We formulate the augmented Lagrangian dual problems and study conditions ensuring existence of the corresponding augmented Lagrange multipliers. We also discu...

متن کامل

Constrained Differential Optimization

Many optimization models of neural networks need constraints to restrict the space of outputs to a subspace which satisfies external criteria. Optimizations using energy methods yield "forces" which act upon the state of the neural network. The penalty method, in which quadratic energy constraints are added to an existing optimization energy, has become popular recently, but is not guaranteed t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Annals OR

دوره 101  شماره 

صفحات  -

تاریخ انتشار 2001